Medical video processing system

ABSTRACT

The medical video processing system is provided with: an encoder 120 that inputs a plurality of video files about a surgical operation, separating the plurality of video files according to a plurality of input systems; a server apparatus 130; and a viewing terminal apparatus 140. The viewing terminal apparatus 140 displays a plurality of timelines related to the plurality of video files, separating the plurality of timelines according to input systems; and synchronously displays, among images included in the plurality of video files corresponding to the displayed timelines, at least a part of a plurality of images associated with a time code of a certain time point included in the time lines, and accepts an operation input by a user to execute editing processing about video files synchronously displayed in a synchronous display area.

TECHNICAL FIELD

The present invention relates to a medical video processing system.

BACKGROUND ART

Recently, for the purpose of securing a plurality of viewpoints in asurgery or recording content of the surgical operation, a medical videoprocessing system not only for directly visually confirming an affectedpart but also for shooting video using a plurality of shootingapparatuses and displaying the video on a monitor has existed.

As conventional inventions about this kind of medical video processingsystem, Patent documents 1 and 2 below are shown.

Patent document 1 discloses an invention in which control informationabout a remotely operated surgical tool, image information obtained byshooting an affected part and the surgical tool, biological informationabout a patient and the like are recorded, together with a unified timecode, and a surgical operation is reproduced based on the recorded timecode and the pieces of information.

Patent document 2 discloses an invention in which editing processing forattaching commands (pointers and a user's comments) to medical video isperformed, and, at the time of reproducing the edited video, a givencommand is displayed at specified time.

CITATION LIST Patent Documents

Patent document 1: Japanese Patent Laid-Open No. 2002-272758

Patent document 2: Japanese Patent Laid-Open No. 2001-195869

SUMMARY OF THE INVENTION Problem to be Solved by the Invention

In the invention according to Patent document 1, although it is possibleto cut out a part of a surgical operation at specified time, based on atime code, it is not possible to cut out the part while checking contentof the surgical operation at the specified time, and, therefore, workfor checking video after the surgical operation requires much time.

In the invention according to Patent document 2, although it is possibleto, by attaching commands to medical video, support checking of thevideo after a surgical operation, the editing is such that is performedfor medical video displayed on a main screen (a central part of amonitor in FIG. 13 of Patent document 2), and there is a lack of an ideafor video displayed on sub-screens (an upper left corner part of themonitor in FIG. 13 of Patent document 2).

The present invention has been made in view of the above problems andprovides a medical video processing system that facilitates editing workabout a medical video file.

Means for Solving the Problem

According to the present invention, there is provided a medical videoprocessing system including: a video input unit that inputs a pluralityof video files about a surgical operation, separating the plurality ofvideo files according to a plurality of input systems; a storage unitthat stores the plurality of video files inputted by the video inputunit in association with a common time code specified with a certaintime point in a period during which the surgical operation is performedas a start point; a display unit that displays the plurality of videofiles stored in the storage unit and information about the video files;and an operation input unit that accepts an operation input by a user tothe display unit; wherein a display area of the display unit includes: atimeline display area to display a plurality of timelines indicatingtime zones corresponding to the plurality of video files about thesurgical operation, separating the plurality of timelines according tothe input systems; and a synchronous display area to synchronouslydisplay, among images included in the plurality of video filescorresponding to the timelines displayed in the timeline display area,at least a part of a plurality of images associated with the time codeof the certain time point included in the time lines; and the medicalvideo processing system further includes an editing unit that executesediting processing about the video files synchronously displayed in thesynchronous display area, based on an operation input accepted by theoperation input unit.

According to the above invention, video files about a surgical operationare synchronously displayed, and a user can perform editing processingfor each video file while checking content of the video file and atimeline and, therefore, can easily perform editing work of the videofile.

Effect of the Invention

According to the present invention, there is provided a medical videoprocessing system that facilitates editing work about a medical videofile.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a diagram showing a medical video processing system accordingto the present embodiment;

FIG. 2 is a diagram showing a specific example of a screen displayed ina display area of an encoder;

FIG. 3 is a diagram showing a specific example of the screen displayedin the display area of the encoder;

FIG. 4 is a diagram showing a specific example of the screen displayedin the display area of the encoder;

FIG. 5 is a diagram showing a specific example of a screen displayed ina display area of a viewing terminal apparatus;

FIG. 6 is a diagram showing a specific example of the screen displayedin the display area of the viewing terminal apparatus;

FIG. 7 is a diagram showing a specific example of the screen displayedin the display area of the viewing terminal apparatus;

FIG. 8 is a diagram showing a specific example of the screen displayedin the display area of the viewing terminal apparatus;

FIG. 9 is a diagram showing a specific example of the screen displayedin the display area of the viewing terminal apparatus;

FIG. 10 is an enlarged view in which a part of a timeline display areais enlarged;

FIG. 11 is an enlarged view in which a part of the timeline display areais enlarged;

FIG. 12 is an enlarged view in which a part of the timeline display areais enlarged;

FIG. 13 is a diagram showing a specific example of a case where acapture processing screen is popped up on the viewing terminalapparatus;

FIG. 14 is a diagram showing a specific example of a case where a“Section” tag is selected on the viewing terminal apparatus; and

FIG. 15 is an enlarged view in which a related information display areain the case where the “Section” tag is selected is enlarged.

DESCRIPTION OF EMBODIMENT

An embodiment of the present invention will be described below withreference to the drawings. Note that, in all the drawings, similarcomponents are given the same reference numerals, and descriptionthereof will not be repeated.

<Components Included in Medical Video Processing System 100>

FIG. 1 is a diagram showing a medical video processing system(hereinafter referred to as a medical video processing system 100)according to the present embodiment.

Arrows shown in FIG. 1 indicate output sources and input destinations ofvideo files given and received among components. Therefore, as forgiving and receiving of information and data other than video files, thegiving and receiving do not necessarily have to correspond to contentindicated by each arrow.

In description below, a video file may be a file configured only withvideo data or may be what includes video data and voice data.

The medical video processing system 100 is provided with a plurality ofshooting apparatuses (cameras 111 to 114), an encoder 120, a serverapparatus 130 and a viewing terminal apparatus 140.

The cameras 111 to 114 are shooting apparatuses that shoot a surgicallyoperated person (a patient) who is undergoing a surgical operation andsurroundings around the surgically operated person to generate a videofile.

For example, the cameras 111 and 113 are cameras to shoot a surgicalfield of the surgical operation, and the camera 113 shoots a wider rangein comparison with the camera 111. The camera 112 shoots a heart ratemonitor, and the camera 114 shoots a monitor that displays a magneticresonance imaging (MRI) image or the like. The cameras 112 and 114shares a role of shooting a biological information monitor that displaysbiological information about the surgically operated person of thesurgical operation.

Note that the number and shooting targets of the cameras 111 to 114mentioned here are mere examples and do not restrict the embodiment ofthe present invention.

The encoder 120 performs encode processing (encoding) for video filesgenerated by the cameras 111 to 114 to convert the video files to aformat suitable for transfer to and storage into the server apparatus130.

Note that it is preferable that the encoder 120 performs compressionprocessing for the video files to cause the video files to be storedinto the server apparatus 130. This is because the size of the videofiles stored into the server apparatus 130 can be reduced thereby.

The encoder 120 performs control about shooting by the cameras 111 to114 based on a user operation, and separates video files about asurgical operation generated by the shooting according to a plurality ofinput systems (according to the cameras 111 to 114) to input the videofiles. In other words, the encoder 120 constitutes a video input unitand a shooting control unit according to the present invention.

Here, the “control about shooting by the cameras 111 to 114” refers tocausing the cameras 111 to 114 to execute start of recording, pause ofrecording and stop of recording of video, and shooting of a still imagein the present embodiment. Note that the content of the control aboutshooting by the cameras 111 to 114 mentioned here is mere examples anddoes not restrict the embodiment of the present invention.

The server apparatus 130 stores the video files transferred from theencoder 120. More specifically, the server apparatus 130 stores theplurality of video files inputted by the encoder 120 in association witha common time code specified with a certain time point in a period inwhich the surgical operation is performed, as a start point. In otherwords, the server apparatus 130 constitutes a storage unit according tothe present invention.

Here, the time code is time-series information (information about orderof frames constituting a video file) associated with video file, and itis preferable that the time code is given for each frame. The startpoint of the time code may be freely specified by a user of the encoder120 (for example, a surgical operator or his/her assistant) within theperiod in which the surgical operation is performed, or a signalindicating the start time point of the surgical operation may beinputted from an external apparatus (not shown in the drawings) tospecify the signal as a trigger.

The viewing terminal apparatus 140 is a computer apparatus in whichapplication software (a viewer) for reproducing the video files storedin the server apparatus 130 is installed.

The viewing terminal apparatus 140 accesses the video files stored inthe server apparatus 130 to display (synchronously reproduce) theplurality of video files associated with the common time code.Furthermore, the viewing terminal apparatus 140 can also displayinformation about the video files that are being synchronouslyreproduced together. Further, the viewing terminal apparatus 140 canaccept a user operation input thereto and execute editing processingabout the video files displayed in a synchronous display area to bedescribed later, based on the accepted operation input. In other words,the viewing terminal apparatus 140 constitutes a display unit and anoperation input unit according to the present invention.

In description below, “display of a video file” and “reproduction of avideo file” are almost synonymous and are used without distinction.

Although it is shown in FIG. 1 as if there were a single viewingterminal apparatus 140, the medical video processing system 100 may beprovided with a plurality of viewing terminal apparatuses 140. Theviewer installed in the viewing terminal apparatus 140 does notnecessarily have to be realized by application software dedicated to thepresent invention but may be realized by general-purpose applicationsoftware (for example, an internet browser) or software obtained byimproving or changing the general-purpose application software.

The server apparatus 130 can execute the editing processing about thevideo files synchronously displayed in a part (the synchronous displayarea to be described later) of a display area of the viewing terminalapparatus 140 based on an operation input accepted by the viewingterminal apparatus 140. In other words, the server apparatus 130constitutes an editing unit according to the present invention.

In the present embodiment, the server apparatus 130 (the editing unit)and the viewing terminal apparatus 140 (the display unit and theoperation input unit) are realized as individual apparatuses. The reasonis as follows. In order to enable the editing processing to be executedin the viewing terminal apparatus 140, it is necessary to execute theediting processing after transferring an editing target video file fromthe server apparatus 130 to the viewing terminal apparatus 140. If sucha system configuration is adopted, it becomes difficult to ensureadequate security for management of the video files in the medical videoprocessing system 100 (the server apparatus 130), and there is apossibility that inappropriate leakage of a video file is invited.

Medical video files are highly confidential personal information, andthe medical video processing system 100 of the present embodiment adoptsthe configuration described above in order to prevent leakage of thevideo files outside.

<Operation of the Encoder 120>

Next, operation of the encoder 120 will be described with reference toFIGS. 2 to 4.

FIGS. 2 to 4 are diagrams showing specific examples of a screendisplayed in a display area of the encoder 120. FIG. 2 is a diagramshowing the display area of the encoder 120 before recording. FIG. 3 isa diagram showing the display area of the encoder 120 during recording.FIG. 4 is a diagram showing the display area of the encoder 120 in acase where an enlarged screen is displayed during recording.

The display area of the encoder 120 functions as a graphical userinterface (GUI), and the user can operate the encoder 120 by operatingan icon or the like on a display using an input device (a mouse, akeyboard or the like) not shown in the drawings, which is attached tothe encoder 120. When the display area of the encoder 120 is a touchpanel, the display area itself functions as an input device.

In the display area of the encoder 120, an input screen 1201, an outputscreen 1202 and a state display 1203 are displayed.

The input screen 1201 is a screen to reproduce any of video filesinputted from the cameras 111 to 114. For example, FIGS. 2 to 4 show astate in which a video file inputted from the camera 111 is beingreproduced on the input screen 1201.

The output screen 1202 is a screen to reproduce a video file outputtedfrom the encoder 120 to the server apparatus 130. Output formats by theencoder 120 include a recording format (an output format to cause aninputted video file to be stored into the server apparatus 130), a liveformat (an output format to output an inputted video file to the viewingterminal apparatus 140 in a manner that the video file can belive-distributed) and a combination of the recording format and the liveformat. The display area of the encoder 120 shown in FIGS. 3 and 4 isthe display area in a case where the encoder 120 is outputting videofiles in the recording format.

The state display 1203 shows a state of a video file being reproduced onthe output screen 1202 at that time point, that is, a video file beingoutputted to the server apparatus 130. Specifically, in the statedisplay 1203, which output format a video file is being outputted in, atime during which output is being performed, a data size of theoutputted video file, and the like are displayed.

In the display area of the encoder 120, a recording start button 1204, arecording stop button 1205, a still image shooting button 1206 and arecording pause button 1207 are displayed.

The recording start button 1204 is a button to accept an operation to bea trigger for staring recording of a video file being reproduced on theinput screen 1201 (processing for storage into the server apparatus130).

The recording stop button 1205 is a button to accept an operation to bea trigger for stopping recording of a video file (processing for storageinto the server apparatus 130).

The still image shooting button 1206 is a button to accept an operationto be a trigger for causing one frame of a video file being reproducedon the input screen 1201 to be stored into the server apparatus 130 as astill image.

The recording pause button 1207 is a button to accept an operation to bea trigger for pausing recording of a video file (processing for storageinto the server apparatus 130) or an operation to be a trigger forreleasing pause.

Note that the recording start button 1204 is not displayed during aperiod during which a video file is being recorded (including a periodduring which recording is paused), and the recording pause button 1207is not displayed during a period during which a video file is not beingrecorded. Therefore, if the recording start button 1204 is operatedduring the period during which recording is not being operated, therecording start button 1204 is replaced with the recording pause button1207; and, if the recording stop button 1205 is performed during theperiod during which recording is being performed, the recording pausebutton 1207 is replaced with the recording start button 1204.

In the display area of the encoder 120, a surgical operation informationdisplay 1208 and an output information display 1209 are displayed.

The surgical operation information display 1208 displays informationrelated to a surgical operation of a video file being reproduced on theinput screen 1201, specifically, an identification number and name of asurgically operated person (a patient), a name of a surgical operator, aname of a medical department, a name of a place where the surgicaloperation is being performed, and the like. The name of a surgicaloperator and the name of a medical department can be selected by a useroperation input to the surgical operation information display 1208. Asfor information that does not require a user operation input, among thepieces of information displayed on the surgical operation informationdisplay 1208, the information may be imported from an external system(for example, an electronic medical record system or the like) not shownin the drawings.

The output information display 1209 displays a file format of a videofile being reproduced on the output screen 1202, whether or not voiceoutput is being performed together with reproduction of the video file,and in which output format output to the server apparatus 130 isperformed. The pieces of information displayed on the output informationdisplay 1209, which have been given here, can be selected by a useroperation input to the output information display 1209.

In the display area of the encoder 120, an extended display activationbutton 1210 and an extended display stop button 1214 are displayed.

The extended display activation button 1210 is a button to accept anoperation to be a trigger for turning on an extended display area wherea video file inputted from an input system different from an inputsystem of a video file being reproduced on the input screen 1201 or theoutput screen 1202 is to be reproduced. For example, FIG. 4 shows astate in which, in the extended display area, a video file inputted fromthe camera 112, a video file inputted from the camera 113 and a videofile inputted from the camera 114 are displayed on a sub-screen 1211, asub-screen 1212 and a sub-screen 1213, respectively. When a video filereproduced in the extended display area is being recorded in the abovestate, an icon similar to the recording pause button 1207 is displayedbeing superimposed on the video file. By operating this icon, recordingis paused. Further, when a video file reproduced in the extended displayarea is not being recorded in the above state, an icon similar to therecording start button 1204 is displayed being superimposed on the videofile. By operating this icon, recording is started.

The extended display stop button 1214 is a button which is displayedwhen the above extended display area is displayed and accepts anoperation to be a trigger for turning off the extended display area.

<Synchronous Display on Viewing Terminal Apparatus 140>

Next, a synchronous display on the viewing terminal apparatus 140 willbe described with reference to FIGS. 5 to 12.

FIGS. 5 to 9 are diagrams showing specific examples of a screendisplayed in the display area of the viewing terminal apparatus 140.More specifically, FIG. 5 is a diagram showing a display aspect inwhich, in a synchronous display area DA1, one video file is reproducedon a main screen, and other video files are reproduced on sub-screens.FIG. 6 is a diagram showing a display aspect in which the synchronousdisplay area DA1 is divided in four, and four video files are reproducedin the four, respectively. FIG. 7 is a diagram showing a state in whicha cursor is positioned on the main screen in the synchronous displayarea DA1. FIG. 3 is a diagram showing a state in which the cursor ispositioned on a still image displayed below the main screen in thesynchronous display area DA1. FIG. 9 is a diagram showing a state inwhich the cursor is positioned on a sub-screen in the synchronousdisplay area DA1.

FIGS. 10 to 12 are enlarged views in which a part of a timeline displayarea DA3 is enlarged. More specifically, FIG. 10 is an enlarged view inwhich a left part of the timeline display area DA3 is enlarged. FIG. 11is an enlarged view in which a central part, of the timeline displayarea DA3 is enlarged. FIG. 12 is an enlarged view in which a right partof the timeline display area DA3 is enlarged.

The display area of the viewing terminal apparatus 140 functions as agraphical user interface, and the user can operate the viewing terminalapparatus 140 by operating an icon or the like on a display using aninput device not shown in the drawings, which is attached to the viewingterminal apparatus 140. When the display area of the viewing terminalapparatus 140 is a touch panel, the display area itself functions as aninput device.

In description below, the cursor pointing a target of an operation bythe input device will be referred to as a pointer 1401.

The display area of the viewing terminal apparatus 140 includes thesynchronous display area DA1, a related information display area DA2 andthe timeline display area DA3.

Note that ranges indicated by broken lines in FIGS. 5 to 9 show rangesof the display areas enumerated here and are not ranges actuallydisplayed on the display area of the viewing terminal apparatus 140.

The synchronous display area DA1 synchronously displays, among imagesincluded in a plurality of video files corresponding to timelinesdisplayed in the timeline display area DA3, a plurality of imagesassociated with a time code of a certain time point included in thetimelines displayed in the timeline display area DA3.

For example, if an icon on a left side of a divided aspect selectionportion 1425 (see FIG. 12) is selected by a user operation input, thesynchronous display area DA1 displays a video file inputted from thecamera 111 on the main screen and displays a video file inputted fromthe cameras 112 to 114 on the sub-screens (see FIG. 5).

If an icon on a right side of the divided aspect selection portion 1425is selected by a user operation input, the synchronous display area DA1displays four video files inputted from the cameras 111 to 114 inequally divided four display areas (see FIG. 6).

When it is attempted to synchronously reproduce a plurality of videofiles in the synchronous display area DA1, reading time differenceoccurs in starting or reproducing the video files due to differenceamong bit rates of the video files. The magnitude of the reading timedifference is not constant because it is influenced by processingcapacities of the server apparatus 130, the viewing terminal apparatus140 and a network line (not shown in the drawings) connecting these.Therefore, communication about buffer time is performed among functionsof reproducing video files on each screen (hereinafter referred to asreproduction players) in the viewing terminal apparatus 140 to solve theabove problem.

For example, in the case of reproducing a video file on one screen (forexample, the main screen), all data of the video file is not read at thefirst stage, but, for example, data corresponding to the first fiveseconds is read, and, while the data is being reproduced, datacorresponding to the next five seconds is read. By sequentiallyrepeating this, continuous reproduction is realized.

By utilizing time required to cause such data corresponding to apredetermined time to be stored into a buffer, a configuration is madein which, for example, in the case of simultaneously startingreproduction on one screen (for example, the main screen) and anotherscreen (for example, a sub-screen), when the reproduction player of themain screen has finished reading of data of a video file correspondingto five seconds, the reproduction player of the main screen notifies thereproduction player of the sub-screen to that effect and reproduction ofthe both reproduction players are started being triggered by thenotification.

Note that such notification is not limited to the case wherereproduction is simultaneously started on a plurality of reproductionplayers but may be further performed in a case where, while a video fileis being reproduced on one reproduction player, reproduction of a videofile started on another reproduction player, case where, while videofiles are being reproduced on a plurality of reproduction players,reproduction of video files are discontinued (a time zone during whichrecording is not performed starts) on a part of the reproductionplayers, and the like.

On the related information display area DA2, information related tovideo files being displayed in the synchronous display area DA1 isacquired from the server apparatus 130 or an external apparatus (orsystem) not shown in the drawings and selectively displayed.

For example, when an “Event” tag is selected in the related informationdisplay area DA2 (in a state shown in FIG. 5 and the like), eventinformation about a surgical operation (about start of the operation,start of anesthetic administration and the like) and time informationcorresponding to the event information, which have been inputted from anexternal system that manages anesthetic administration is displayed inthe related information display area DA2, the external system not beingshown in the drawings.

When a “Comment” tag is selected in the related information display areaDA2 (a state shown in FIG. 8), times (time codes) corresponding to stillimages captured by capture processing to be described later and commentsattached to the still images by the user are displayed in the relatedinformation display area DA2.

When a “Section” tag is selected in the related information display areaDA2 (a state shown in FIG. 14), a time zone specified by sectionidentification processing to be described later are displayed in therelated information display area DA2. In description below, the sectionmeans a time zone specified by the section identification processing.

When a “Surgical Procedure” tag is selected in the related informationdisplay area DA2 (not shown in the drawings), video files andinformation related to the video files, which are recorded in the serverapparatus 130, are displayed in the related information display area DA2based on the same surgical procedure as video files being synchronouslydisplayed in the synchronous display area DA1.

When a “Diagnosed Name” tag is selected in the related informationdisplay area DA2 (not shown in the drawings), video files andinformation related to the video files, which are recorded in the serverapparatus 130, are displayed in the related information display area DA2based on the same diagnosed name as video files being reproduced in thesynchronous display area DA1.

When a “Video File of Same Patient” tag is selected in the relatedinformation display area DA2 (not shown in the drawings), video filesand information related to the video files, which are recorded in theserver apparatus 130, being associated with the same patient ID as videofiles being reproduced in the synchronous display area DA1, aredisplayed in the related information display area DA2.

Note that the pieces of information displayed in the related informationdisplay area DA2, which have been enumerated here, are mere examples,and information other than the pieces of information enumerated here maybe displayed in the related information display area DA2, or at least apart of the pieces of information enumerated here may not be displayed.Further, as for the layout at the time of displaying various kinds ofinformation in the related information display area DA2, layouts shownin the drawings are only examples, and the layout of the relatedinformation display area DA2 is not restricted to what have been shownin the drawings at the time of practicing the present invention.

The event, information and time information inputted from the externalsystem not shown in the drawings are inputted to the server apparatus130, associated with video files about the surgical operation andaccumulated in the server apparatus 130 together with the video files.In other words, an external input unit of the present invention isconfigured with the server apparatus 130.

As is apparent from comparison between FIGS. 5 and 6, rates of thesynchronous display area DA1 and the related information display areaDA2 occupying the display area of the viewing terminal apparatus 140 aredifferent between the case of divided displays on the main screen andthe sub-screens and the case of even division into four. The synchronousdisplay area DA1 and the related information display area DA2 in thelatter case are smaller and larger, respectively, in comparison with theformer case.

The timeline display area DA3 displays timelines indicating time zonescorresponding to a plurality of video files about a surgical operationfor the input systems (the cameras 111 to 114), respectively.

Here, the timeline is a linear or belt-shaped display and indicates inwhich time zone a video file is recorded or in which time zone the videofile is not recorded.

It is preferable that the timelines displayed in the timeline displayarea DA3 are displayed based on a time code associated with video filesrelated to the timelines. Further, it is preferable that the timelinesare identifiably in different display aspects (for example, thetimelines are in different colors).

In the timeline display area DA3, besides the timelines, a cursor 1414showing a time point of being synchronously displayed in the synchronousdisplay area DA1 is displayed, being superimposed on the timelines (seeFIG. 10).

The cursor 1414 in the present embodiment is configured with a windowframe in which the time point (both of the time and elapsed time fromrecording start time) is displayed, and a linear display extending overthe plurality of input systems.

The cursor 1414 is provided not only with the role of showing a timepoint of being synchronously displayed in the synchronous display areaDA1 but also with, for example, a function of, by being slid left orright along a time axis by a user operation, causing video files at atime point freely specified by the user to be synchronously displayed inthe synchronous display area DA1.

Above and below a timeline displayed in the timeline display area DA3,tag displays are displayed.

Here, a tag display displayed above the timeline shows time (a timecode) associated with event information displayed when the “Event” tagin the related information display area DA2 is selected, on thetimeline. For example, a tag display 1413 in FIG. 10 is a tag displayattached above a timeline about the camera 111 (a timeline shown as“Video. 1”) and is associated with event information 1412 of “16:50:15Start Operation” shown in FIG. 7.

A tag display displayed below the timeline shows time (a time code)associated with comment information displayed when the “Comment” tag inthe related information display area DA2 is selected. For example, a tagdisplay 1415 in FIG. 10 is a tag display attached below the timelineabout the camera 111 and is associated with comment information 1407 of“17:04:08 Conference 1” shown in FIG. 8 (which is inputted by commentprocessing to be described later) and a still image 1404 at the sametime (captured by the capture processing to be described later).

In order to attach the tag displays described above to the timeline, theserver apparatus 130 executes first tag processing and second tagprocessing as shown below.

The first tag processing is processing for, in association with a timecode of a certain time point included in a timeline displayed in thetimeline display area DA3, attaching a tag display below the timeline.

The second tag processing is processing for, in association with thetime code of the certain time point included in the timeline displayedin the timeline display area DA3, attaching a tag display above thetimeline, based on event information and time information inputted fromthe external system.

While the first tag processing is processing performed, being triggeredby a user operation input to the viewing terminal apparatus 140(specifically an operation of a capture icon 1426 to be describedlater), the second tag processing is different in that it is processingautomatically performed, being triggered by predetermined informationbeing inputted from an external system.

For either of the tag displays attached to above and below the timeline,by specifying the tag display with the pointer 1401, time pointssynchronously displayed in the synchronous display area DA1 can bechanged to time (a time code) associated with the specified tag display.At this time, a display position of the cursor 1414 also moves to aposition corresponding to the time.

For either of the tag displays attached above and below the timeline, iftime (a time code) shown by the tag display corresponds to a time pointshown by the cursor 1414 (time points synchronously displayed in thesynchronous display area DA1), event information or comment informationassociated with the time is superimposedly displayed in a display areaof a video file of an input system corresponding to the timeline towhich the tag display is attached.

In the case of divided displays on the main screen and the sub-screens,when the pointer 1401 is superimposed on the main screen, a full-screendisplay icon 1402 is displayed on the center of the main screen, aninput system display 1403 showing an input system corresponding to avideo file being reproduced on the main screen is displayed on an upperright corner part of the main screen, and still images captured from thevideo file being reproduced on the main screen (what are captured by thecapture processing to be described later) are shown on a lower part ofthe main screen (see FIG. 7).

At this time, by operating the full-screen display icon 1402 with thepointer 1401, the video file being reproduced on the main screen isfull-screen displayed (not shown in the drawings).

In the above case, if the pointer 1401 is superimposed on a still imagedisplayed on the lower part of the main screen (for example, the stillimage 1404), a comment editing icon 1405 and a deletion icon 1406 aredisplayed in the display area of the still image 1404. Then, commentinformation 1403 similar to the comment information 1407 associated withthe still image 1404 is displayed on the main screen (see FIG. 8).

When the deletion icon 1406 is operated with the pointer 1401, thetarget still image 1404 and the comment information 1407 associatedtherewith are deleted and disappear from the display area of the viewingterminal apparatus 140.

Since processing about the comment editing icon 1405 corresponds to theediting processing of the present invention, the processing will bedescribed later.

In the case of divided displays on the main screen and the sub-screens,when the pointer 1401 is superimposed on a sub-screen, a full-screendisplay icon 1409 and a display switching icon 1410 are displayed on thesub-screen, and an input system display 1411 showing an input systemcorresponding to a video file being reproduced on the sub-screen isdisplayed on an upper right corner portion of the sub-screen (see FIG.9).

At this time, by operating the full-screen display icon 1409 with thepointer 1401, the video file being reproduced on the sub-screen isfull-screen displayed (not shown in the drawings).

Further, at this time, by operating the display switching icon 1410 withthe pointer 1401, the video file being reproduced on the sub-screen isexchanged for a video file being reproduced on the main screen (notshown in the drawings).

On a lower left part of the timeline display area DA3, reproductionspeed selection icons 1416 are disposed (see FIG. 10).

The reproduction speed selection icons 1416 are icons for selecting areproduction speed of video files being synchronously displayed in thesynchronous display area DA1.

More specifically, the reproduction speed selection icons 1416 areoperation icons for selecting “0.5× speed”, “1× speed”, “1.5× speed”,“2× speed”, “4× speed”, “6× speed” and “8× speed” shown in FIG. 10 inthat order from a left side.

Note that the reproduction speed alternatives enumerated here are onlyan example, and can be appropriately changed in practicing the presentinvention.

On a lower center part of the timeline display area DA3, operation iconsfor reproduction control are disposed (see FIG. 11).

A forward jump icon 1417 is an operation icon for causing a displayposition of the cursor 1414 (a time point of being synchronouslydisplayed in the synchronous display area DA1) to jump to a displayposition of the nearest “Comment” tag on a forward side of the displayposition.

A 30-second backward icon 1418 is an operation icon for changing a timepoint of being synchronously displayed in the synchronous display areaDA1 to a time point thirty seconds before.

A 10-second backward icon 1419 is an operation icon for changing a timepoint of being synchronously displayed in the synchronous display areaDA1 to a time point ten seconds before.

A reproduction icon 1420 is an operation icon for causing reproductionof video files to start in the synchronous display area DA1.

A stop icon 1421 is an operation icon for causing reproduction of videofiles in the synchronous display area DA1 to stop.

A 10-second forward icon 1422 is an operation icon for changing a timepoint of being synchronously displayed in the synchronous display areaDA1 to a time point ten seconds after.

A 30-second forward icon 1423 is an operation icon for changing a timepoint of being synchronously displayed in the synchronous display areaDA1 to a time point thirty seconds after.

A backward jump icon 1424 is an operation icon for causing a displayposition of the cursor 1414 (a time point of being synchronouslydisplayed in the synchronous display area DA1) to jump to a displayposition of the nearest “Comment” tag on a backward side of the displayposition.

Note that the operation icons for reproduction control enumerated hereare only examples. An operation icon for reproduction control other thanthe operation icons enumerated here may be provided, or at least a partof the operation icons for reproduction control enumerated here may beomitted.

Further, the functions of the operation icons for reproduction controlenumerated here are mere examples. In practicing the present invention,operation icons provided in similar display aspects may realizedifferent functions. For example, the forward jump icon 1417 or thebackward jump icon 1424 may be such that causes a display position ofthe cursor 1414 to jump to a display position of the nearest “Event” tagon a forward side or a backward side of the display position.

On a lower right part of the timeline display area DA3, operation iconsas below are disposed (see FIG. 12).

When an icon on a left side of a divided aspect selection portion 1425is operated, the synchronous display area DA1 is divided into the mainscreen and the sub-screens (see FIG. 5). When an icon on a right side isoperated, the synchronous display area DA1 is divided into four (seeFIG. 6).

Time axis selection icons 1428 are buttons to accept an operation ofincreasing/decreasing a display width of a unit time (one minute in thepresent embodiment) of a time axis (a horizontal axis) in the timelinedisplay area DA3. More specifically, the time axis selection icons 1428are an operation icon to maximize the display width of the unit time ofthe time axis in the timeline display area DA3, an operation icon tocause the display width to be wider by one stage, an operation icon tocause the display width to be narrower by one stage and an operationicon to minimize the display width, in that order from a left side inFIG. 12.

The capture icon 1426 is an operating icon for capturing a still imagefrom video files being synchronously displayed in the synchronousdisplay area DA1.

Since each processing about the capture icon 1426 corresponds to theediting processing of the present invention, the processing will bedescribed later.

<Editing Processing of Video Files Synchronously Displayed>

Next, editing processing of video files synchronously displayed in thesynchronous display area DA1 will be described with reference to FIGS.13 to 15.

FIG. 13 is a diagram showing a specific example in a case where acapture processing screen DA4 is popped up on the viewing terminalapparatus 140. FIG. 14 is a diagram showing a specific example in a casewhere the “Section” tag is selected on the viewing terminal apparatus140. FIG. 15 is an enlarged view in which the related informationdisplay area DA2 in the case where the “Section” tag is selected isenlarged.

When the capture icon 1426 is operated with the pointer 1401, thecapture processing screen DA4 for accepting an operation about thecapture processing is popped up on the viewing terminal apparatus 140(see FIG. 13).

Here, to be “popped up” refers to being displayed on a front (a higherlayer) of other display areas (for example, the synchronous display areaDA1, the timeline display area DA3 and the like) displayed on theviewing terminal apparatus 140.

In the capture processing screen DA4, an image of a video filesynchronously displayed in the synchronous display area DA1 at a timepoint of operating the capture icon 1426 (in FIG. 13, an image of themain screen (an image of Video. 1)) is captured and displayed as a stillimage 1433.

In the capture processing screen DA4, a comment input field 1430 forinputting comment information, a storage icon 1431 for storing acaptured still image and a deletion icon 1432 for erasing display on thecapture processing screen DA4 (stopping the capture processing) are alsodisplayed in addition to the still image 1433.

In the comment input field 1430, the user can input a given commentinformation based on a user operation input to an operation unit notshown in the drawings (for example, a keyboard or the like).

When the storage icon 1431 is operated with the pointer 1401 after textinformation is inputted to the comment input field 1430, the inputtedcomment information is stored into the server apparatus 130, beingassociated with the still image 1433 and a time code corresponding tothe still image 1433.

When the storage icon 1431 is operated with the pointer 1401 withoutinputting text information to the comment input field 1430, commentinformation from which it can be recognized that text information hasnot been inputted (for example, “Untitled” or the like) is stored intothe server apparatus 130, being associated with the still image 1433 andthe time code corresponding to the still image 1433.

The capture processing screen DA4 is similarly popped up on the viewingterminal apparatus 140 when the comment editing icon 1405 is operated,without being limited to the case where the capture icon 1426 isoperated.

A display aspect of the capture processing screen DA4 and processingperformed according to an operation of each operation icon are similarto the above description, detailed description thereof will not berepeated.

The following is a summary of the capture processing described above.

First, the server apparatus 130 can execute the capture processing forcapturing an image included in a video file corresponding to a timelinedisplayed in the timeline display area DA3 as a still image according toan operation of the capture icon 1426.

Furthermore, when the above capture processing is executed, the serverapparatus 130 can execute the first tag processing for attaching a tagdisplay below the timeline in association with a time code (that is, atime code of a certain time point included in the time line)corresponding to the image and comment processing for inputting a givencomment in association with the time code corresponding to the tagdisplay attached by the first tag processing, based on a user operationinput together.

In other words, the operation of the capture icon 1426 is a useroperation input to be a trigger for the capture processing, the firsttag processing and the comment processing. Note that it is shown in eachdiagram of the present embodiment as if the timeline targeted by theabove capture processing and first tag processing were only the timelineof “Video. 1” (the timeline about the camera 111), similar processingmay be executed for the other timelines (timelines about the cameras 112to 114) as a target.

At the time of executing the capture processing as described above, theuser using the medical video processing system 100 can execute thecapture processing, referring to video files displayed in thesynchronous display area DA1, related information displayed in therelated information display area DA2, and timelines (time-seriesinformation) displayed in the timeline display area DA3. Therefore, theuser can easily find a desired still image from the video filesdisplayed in the synchronous display area DA1 and store the still image.

Next, when the “Section” tag in the related information display area DA2is operated with the pointer 1401, various operation icons and the likefor accepting an operation about the section identification processingand a list of sections specified by the section identificationprocessing are displayed (see FIG. 14).

Note that, although description will be made on an embodied aspect inwhich the operation icons and the like about the section identificationprocessing are displayed in the related information display area DA2 inthe present embodiment, another display area including the operationicons about the section identification processing may be popped up onthe screen of the viewing terminal apparatus 140 similarly to thecapture processing.

The following are displayed in the “Section” tag in the relatedinformation display area DA2 (see FIG. 15).

A section display portion 1440 displays sections specified before. Inthe case of an example shown in FIG. 15, in the section display portion1440, the whole time zone in which recording is performed is indicatedby a solid-color timeline, and which time zone in the whole time zoneeach section specified by the section identification processingcorresponds to is indicated by a shaded area. Here, “the whole time zonein which recording is performed” refers to a total of time zones inwhich at least one of the cameras 111 to 114 performs shooting in theperiod during which the surgical operation is performed. In the presentembodiment, since a video file inputted from the camera 111 is such thatis recorded through a period during which a surgical operation isperformed, a time zone indicated by a timeline corresponding to thevideo file (the timeline shown as “Video. 1” in FIG. 5 and the like) isequal to “the whole time zone”. In other words, the solid-color part ofeach timeline in the section display portion 1440 indicates a timelength equal to recording time of the video file of “Video. 1” displayedin the synchronous display area DA1.

Input system specification boxes 1441 are checkboxes to specify, foreach section (a time zone indicated by a shaded part) displayed in thesection display portion 1440, input systems (among the cameras 111 to114) targeting the sections. For example, if checkboxes indicated by“V1”, “V2”, “V3” and “V4” are checked, video files inputted from thecamera 111, the camera 112, the camera 113 and the camera 114,respectively, are targeted. The user can optionally check or uncheckeach checkbox by an operation with the pointer 1401. However, aconfiguration is made in which, if a video file of an input systemcorresponding to a checkbox does not exist in each section (if recordingis not performed), checking of the checkbox is disabled, so that uselessspecification cannot be performed.

A section number display portion 1436 includes identification numbers ofthe sections (for example, what are indicated by “#1” to “#6”, or thelike) and checkboxes specifying the sections. The checkboxes included inthe section number display portion 1436 are used for processingcorresponding to an operation of a section deletion icon 1447 or adownload icon 1448 to be described later.

Each of individual reproduction icons 1437 is an operation icon toaccept an operation of causing video files associated with acorresponding section to be synchronously displayed in the synchronousdisplay area DA1. Video files synchronously displayed according to anoperation of each of the individual reproduction icons 1437 correspondto a section displayed in the section display portion 1440 and are videofiles of input systems specified by the input system specification boxes1441.

Each of individual download icons 1438 is an operation icon to accept anoperation of causing a corresponding section to be downloaded to aspecified storage destination (a storage area specified by any ofstorage destination checkboxes 1445 to be described later). Video filesdownloaded according to an operation of each of the individual downloadicons 1433 correspond to a section displayed in the section displayportion 1440 and are video files of input systems specified by theinput, system specification boxes 1441.

A start/end input field 1444 is a display field to accept an input of astart time point and an end time point specified by the sectionidentification processing. The start/end input field 1444 is configuredwith a field to input a numerical value in “hours”, a field to input anumerical value in “minutes” and a field to input a numerical value in“seconds” in that order from a left side. In each field of the start/endinput field 1444, the user can input a given numerical value based on auser operation input to the operation unit not shown in the drawings(for example, the keyboard or the like).

A start time point setting icon 1442 is an operation icon to accept anoperation of inputting a display position of the cursor 1414 (a timepoint of being displayed in the synchronous display area DA1) to a starttime point display field in the start/end input field 1444.

An end time point setting icon 1443 is an operation icon to accept anoperation of inputting a display position of the cursor 1414 (a timepoint of being synchronously displayed in the synchronous display areaDA1) to an end time point display field in the start/end input field1444.

The storage destination checkboxes 1445 are checkboxes to specify astorage area to be a storage destination in download processingperformed according to an operation of any of individual download icons1438 or the download icon 1448. In FIG. 15, a storage area indicated by“My Video” means a storage area provided in the server apparatus 130 fora user who is logged in at that time, and “Viewing Terminal” means astorage area provided in the viewing terminal apparatus 140 that theuser is viewing at that time point.

A section addition icon 1446 is an operation icon to accept an operationof adding a section to be displayed in the section display portion 1440,according to a start time point and an end time point inputted in thestart/end input field 1444 at that time point.

The section deletion icon 1447 is an operation icon to accept anoperation of deleting a section corresponding to a checkbox in thesection number display portion 1436 that is checked at that time point(erasing the section from a list displayed in the section displayportion 1440).

The download icon 1448 is an operation icon to accept an operation ofcausing a video file of an input system which corresponds to a sectionfor which a corresponding checkbox in the section number display portion1436 is checked at that time point and is specified by an input systemspecification box 1441 for each section to be downloaded to a storagearea specified by any of the storage destination checkbox 1445.

The server apparatus 130 executes the section identification processingfor identifying a time zone from a time code of a start time point (afirst time point) to a time code of an end time point (a second timepoint) that are included in a time line displayed in the timelinedisplay area DA3, based on such inputs and settings as described above.

The server apparatus 130 can execute download processing for, from avideo file associated with the time codes included in the time zone (asection) identified by the section identification processing,downloading a video part of the time zone. In a case where a pluralityof video files associated with time codes included in the section arespecified like the section indicated by “#1”, the server apparatus 130can execute the download processing for the specified plurality of videofiles in batch.

Since such download processing as described above can be executed, auser using the medical video processing system 100 can easily obtain oneor more new video files in which only a video part shot during a desiredtime zone is extracted.

<About Modification of the Present Invention>

Although the present invention has been described so far based on theembodiment described with reference to each drawing, the presentinvention is not limited to the above embodiment but includes variousaspects such as modifications, improvements and the like as far as theobject of the present invention is achieved.

Although the description has been made on the assumption of thecomponents shown in FIG. 1 in the above description of the embodiment,each component of the present invention is only required to be formed torealize its functions. Therefore, each component of the presentinvention is not required to be an individual independent existence. Itis permitted for a plurality of components to be formed as one member,for one component to be formed by a plurality of members, for a certaincomponent to be a part of another component, for a part of a certaincomponent and a part of another component are overlapped, and the like.

For example, in the medical video processing system according to thepresent invention, shooting apparatuses corresponding to the cameras 111to 114 may not be included; processing may be performed for a video fileinputted from a shooting apparatus outside the system; and processingmay be performed for a video file inputted from an apparatus different,from a shooting apparatus (for example, a medical measurement apparatusor the like).

The various operations stated in the above embodiment are mere specificexamples, and practicing of the present invention is not limitedthereto. Therefore, each of the above operations may be replaced with adifferent operation; a part of the operations may be omitted; andanother operation that is not described in the embodiment may be added.

The various display aspects stated in the above embodiment are merespecific examples, and practicing of the present invention is notlimited thereto. Therefore, each of the above displays may be replacedwith a different display; a part of the displays may be omitted; andanother display that is not described in the embodiment may be added.

The various kinds of editing processing stated in the above embodimentare mere specific examples, and practicing of the present invention isnot limited thereto. Therefore, a part of each editing processingdescribed above may be omitted, and another editing processing that isnot described in the embodiment may be added.

For example, although it is shown as if a timeline to which a tagdisplay were attached by the above first tag processing and second tagprocessing were only the timeline corresponding to the camera 111, a tagdisplay may be attached to another time line.

In the embodiment stated above, description has been made on theassumption that a video file inputted from the camera 111 is recordedthrough a period during which a surgical operation is performed, and atimeline about the video file (the timeline shown as “Video. 1” in FIG.5 and the like) is equal to what indicates the period during which thesurgical operation is performed. Practicing of the present invention,however, is not limited to this aspect. In other words, in practicing ofthe present invention, it is not necessarily required that a video filerecorded through a period during which a surgical operation is performedexists, and all video files synchronously displayed in the viewingterminal apparatus 140 (the synchronous display area DA1) may be suchthat include a time zone in which recording is stopped.

In the above embodiment, a method for identifying a section targeted bythe download processing, using an operation icon or the like displayedin the “section” tag in the related information display area DA2 hasbeen described. However, processing for identifying a section is notlimited to such a method, but input by a method below is also possible.

For example, it is also permitted that a tag display above or below atime line (a tag display attached by the first tab processing or thesecond tag processing) is specified with the pointer 1401, and time (atime code) associated with the specified tag display is inputted as astart time point or an end time point of a section. In other words, atleast in a part in the case of executing the section identificationprocessing, at least one of the section start time point (the first timepoint) and the section end time point (the second time point) may beidentified based on a user operation input specifying a tag displayattached by the first tag processing or the second tag processing.

The display position of each operation icon stated in the aboveembodiment is a mere example, and practicing of the present invention isnot limited thereto. For the operation icons related to the editingprocessing of the present invention, however, it is preferable that theoperation icons are displayed at such positions that it is possible tooperate the operation icons while referring to the timeline display areaand the synchronous display area. In other words, it is preferable thatthe operation icons related to the editing processing of the presentinvention are displayed on a display unit where the timeline displayarea and synchronous display area of the present invention aredisplayed. Here, the concept of being “displayed on a display unit wherethe timeline display area and synchronous display area are displayed” isnot limited to being displayed in the same display frame (window) butincludes being displayed in separate display frames like the aboveembodiment (see FIGS. 13 and 14), being separately displayed on aplurality of display apparatuses (a multi-monitor) under the control ofthe same platform, and the like.

The present embodiment includes the following technical thoughts:

(1) A medical video processing system including: a video input unit thatinputs a plurality of video files about a surgical operation, separatingthe plurality of video files according to a plurality of input systems;

a storage unit that stores the plurality of video files inputted by thevideo input unit in association with a common time code specified with acertain time point in a period during which the surgical operation isperformed as a start point;

a display unit that displays the plurality of video files stored in thestorage unit and information about the video files; and

an operation input unit that accepts an operation input by a user to thedisplay unit; wherein

a display area of the display unit includes:

a timeline display area to display a plurality of timelines indicatingtime zones corresponding to the plurality of video files about thesurgical operation, separating the plurality of timelines according tothe input systems; and

a synchronous display area to synchronously display, among imagesincluded in the plurality of video files corresponding to the timelinesdisplayed in the timeline display area, at least a part of a pluralityof images associated with the time code of the certain time pointincluded in the time lines; and

the medical video processing system further includes an editing unitthat executes editing processing about the video files synchronouslydisplayed in the synchronous display area, based on an operation inputaccepted by the operation input unit.

(2) The medical video processing system according to (1), wherein

the editing unit executes:

first tag processing for, in association with the time code of thecertain time point included in the time lines displayed in the timelinedisplay area, attaching a tag display to the time lines, based on anoperation input by the user; and

comment processing for inputting a given comment in association with thetime code corresponding to the tag display attached by the first tagprocessing, based on an operation input by the user.

(3) The medical video processing system according to (2), wherein

in the case of executing capture processing for capturing an imageincluded in the video files corresponding to the timelines displayed inthe timeline display area as a still image, the editing unit executesthe first tag processing to attach a tag display in association with atime code corresponding to the image.

(4) The medical video processing system according to (2) or (3), wherein

the editing unit executes:

identification processing for identifying a time zone from a time codeof a first time point to a time code of a second time point included inthe time lines displayed in the timeline display area, based on anoperation input by the user; and

download processing for, from a video file associated with a time codeincluded in the time zone identified by the identification processing,downloading a video part of the time zone.

(5) The medical video processing system according to (4), wherein

when a plurality of video files associated with the time codes includedin the time zone identified by the identification processing arespecified, the editing unit executes the download processing for theplurality of video files.

(6) The medical video processing system according to (4) or (5), wherein

at least in a part in the case of executing the identificationprocessing, at least one of the first time point and the second timepoint is identified based on an operation input by the user specifyingthe tag display attached by the first tag processing.

(7) The medical video processing system according to any one of (1) to(6), including:

an external input unit that inputs event information about the surgicaloperation and time information corresponding to the event informationfrom an external system; wherein

the editing unit executes second tag processing for, in association withthe time code of the certain time point included in the time linesdisplayed in the timeline display area, attaching a tag display to thetime lines, based on the event information and the time informationinputted by the external input unit.

(8) The medical video processing system according to (7) depending on(4) to (6), wherein

at least in a part in the case of executing the identificationprocessing, at least one of the first time point and the second timepoint is identified based on an operation input by the user specifyingthe tag display attached by the second tag processing.

(9) The medical video processing system according to any one of (1) to(8), including:

a plurality of shooting apparatuses that shoot a surgical field of thesurgical operation and a biological information monitor displayingbiological information about a surgically operated person of thesurgical operation; and

a shooting control unit that performs control about shooting by theplurality of shooting apparatuses, based on an operation by the user;wherein

a plurality of video input units input video files for the plurality ofshooting apparatuses, respectively, each of the plurality of video inputunits being the input video unit.

The present application claims priority based on Japanese PatentApplication No. 2017-251482 filed to Japan on Dec. 27, 2017, all thedisclosure of which is incorporated herein.

REFERENCE SIGNS LIST

-   100: medical video processing system-   111, 112, 113, 114: camera-   120: encoder-   130: server apparatus-   140: viewing terminal apparatus-   1201: input screen-   1202: output screen-   1203: state display-   1204: recording start button-   1205: recording stop button-   1206: still image shooting button-   1207: recording pause button-   1208: surgical operation information display-   1209: output information display-   1210: extended display activation button-   1211, 1212, 1213: sub-screen-   1214: extended display stop button-   1401: pointer-   1402, 1409: full-screen display icon-   1403: input system display-   1404: still image-   1405: comment editing icon-   1406: deletion icon-   1407, 1408: comment information-   1410: display switching icon-   1411: input system display-   1412: event information-   1413, 1415: tag display-   1414: cursor-   1416: reproduction speed selection icon-   1417: forward jump icon-   1418: 30-second backward icon-   1419: 10-second backward icon-   1420: reproduction icon-   1421: stop icon-   1422: 10-second forward icon-   1423: 30-second forward icon-   1424: backward jump icon-   1425: divided aspect selection portion-   1426: capture icon-   1428: time axis selection icon-   1430: comment input field-   1431: storage icon-   1432: deletion icon-   1433: still image-   1436: section number display portion-   1437: individual reproduction icon-   1438: individual download icon-   1440: section display portion-   1441: input system specification box-   1442: start time point setting icon-   1443: end time point setting icon-   1444: start/end input field-   1445: storage destination checkbox-   1446: section addition icon-   1447: section deletion icon-   1448: download icon-   DA1: synchronous display area-   DA2: related information display area-   DA3: timeline display area-   DA4: capture processing screen

The invention claimed is:
 1. A medical video processing systemcomprising: a video input unit that inputs a plurality of video filesabout a surgical operation, said plurality of video files recording thesurgical operation for a whole time zone, the plurality of video filescomprising: a first video file comprising first frames of images takenby a first input system to take the surgical operation for a firsttimeline in the whole time zone, and a second video file comprisingsecond frames of images taken by a second input system to take thesurgical operation for a second timeline in the whole time zone, each ofthe first frames having a time code that is common to that of each ofthe second frames, the time code specifying when each of the images istaken; a storage unit that stores the plurality of video files; adisplay unit that displays the plurality of video files stored in thestorage unit, the display unit comprising a timeline display area and asynchronous display area; and an operation input unit that accepts anoperation input by a user to the display unit; wherein the timelinedisplay area displays the first timeline and the second timeline,wherein the synchronous display area synchronously displays each of theimages of the first frames and each of the second frames, wherein saideach of the images of the first frames and said each of the images ofthe second frames synchronously displayed with said each of the imagesof the first frames have the same time code; and wherein the medicalvideo processing system further comprises an editing unit that executesdownload processing based on the operation input at the operation inputunit, wherein the editing unit executes: a first processing step foridentifying a section or sections of the whole time zone based on theoperation input at the operation input unit; and a second processingstep for identifying the section or sections to be downloaded among thesection or sections identified in the first processing step, based onthe operation input at the operation input unit; and a third processingstep for identifying the video files to be download among said pluralityof the video files based on the operation input at the operation inputunit, wherein, when the editing unit that executes the downloadprocessing, the video files identified in the third processing step areedited in batch, thereby downloading a plurality of video file partsedited from the video files identified in the third processing step,each video file part of the video file parts synchronously correspondingto the section identified by the second processing step.
 2. The medicalvideo processing system according to claim 1, wherein the editing unitexecutes: first tag processing for attaching a tag display to the timecode of the first timeline displayed in the timeline display area basedon an operation input by the user; and comment processing for inputtinga given comment in association with the time code corresponding to thetag display based on an operation input by the user.
 3. The medicalvideo processing system according to claim 2, wherein, in the case ofexecuting capture processing for capturing each of the images includedin the first video file having the first timeline or the second videofile having the second timeline displayed in the timeline display areaas a still image, the editing unit executes the first tag processing toattach the tag display in association with the time code correspondingto the still image.
 4. The medical video processing system according toclaim 2, wherein at least in a part in the case of executing theidentification processing, at least one of a first time point and asecond time point is identified based on the operation input by the userspecifying the tag display attached by the first tag processing.
 5. Themedical video processing system according to claim 2, comprising anexternal input unit that inputs event information about the surgicaloperation and time information corresponding to the event informationfrom an external system; wherein the editing unit executes second tagprocessing for, in association with the time code of the certain timepoint included in the first timeline displayed in the timeline displayarea, attaching the tag display to the first timeline, based on theevent information and the time information inputted by the externalinput unit.
 6. The medical video processing system according to claim 5,wherein at least in a part in the case of executing the identificationprocessing, at least one of a first time point and a second time pointis identified based on the operation input by the user specifying thetag display attached by the second tag processing.
 7. The medical videoprocessing system according to claim 1, comprising: a plurality ofshooting apparatuses comprising a first shooting apparatus and a secondshooting apparatus, wherein each of the first shooting apparatus and thesecond shooting apparatus shoots a surgical field of the surgicaloperation and a biological information monitor displaying biologicalinformation about a surgically operated person of the surgicaloperation; and a shooting control unit that performs control aboutshooting by the plurality of shooting apparatuses, based on an operationby the user; wherein the first shooting apparatus is provided for thefirst input system to take the first frames of the images, the secondshooting apparatus is provided for the second input system to take thesecond frames of the images.